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WHAT IS CLAIMED IS : 

1 . A method for tracking an object among a plurality of image frames, 
comprising the steps of: 

defining a background mask for each one frame among a plurality of 
image frames, including a current image frame, the background mask of a given image 
frame comprising background pixels, the background pixels of the given image frame 
being observable for the given image frame; 

maintaining a background model of background pixels which have 
been observable in at least three consecutive image frames; 

classifying each one pixel of the current image frame as being a 
background pixel or a foreground pixel based on the background model, the current 
image frame, and at least one of a prior image frame and a subsequent image frame; 

defining a foreground mask for the current image frame as being pixels 
not in the background mask for said current image frame; and 

identifying the object as being the pixels within the foreground mask 
for the current image frame. 

2 . The method of claim 1 , further comprising the step of performing a 
mask filtering operation on the background mask of the current image frame to decide 
whether to change a pixel classification from being a background pixel in the 
background mask to being a foreground pixel in the foreground mask of the current 
image frame. 

3 . The method of claim 1 , further comprising the step of performing a 
mask filtering operation on the foreground mask of the current image frame to decide 
whether to change a pixel classification from being a foreground pixel in the foreground 
mask to being a background pixel in the background mask of the current image frame. 

4 . The method of claim 1 , further comprising, for each one pixel of a 
current image frame, the step of predicting a background value for said one pixel based 
upon a predicted background value of said one pixel from the prior image frame, a pixel 
value of said one pixel from the current image frame, and a mixing factor. 
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5 . The method of claim 4, in which the step of classifying said each one 
pixel of the current image frame is based in part on the predicted background value for 
said each one pixel. 

6 . The method of claim 1 , in which the step of classifying comprises 
identifying an event from the group of events comprising: prospectively include said 
one pixel in the background mask for the current image frame; motion is detected in the 
immediate past for said one pixel; motion is detected in the immediate future for said 
one pixel; prospectively include said one pixel in the foreground pixel for the current 
image frame; and said one pixel is not to be updated in the background model. 

7 . The method of claim 1, in which the step of classifying comprises 
identifying an event from the group of events comprising: prospectively include said 
one pixel in the background mask for the current image frame; a first degree of motion 
is detected in the immediate past for said one pixel; the first degree of motion is 
detected in the immediate future for said one pixel; a second degree of motion is 
detected in the immediate past for said one pixel; the second degree of motion is 
detected in the immediate future for said one pixel ;prospectively include said one pixel 
in the foreground pixel for the current image frame; and said one pixel is not to be 
updated in the background model. 

8 . An apparatus for tracking an object among a plurality of image frames, 
the apparatus receiving an initial estimate of the object for an initial image frame, the 
apparatus comprising: 

a background model of values for a plurality of background pixels 
which have been observable in at least three consecutive image frames; 

a processor which classifies each one pixel of the current image frame 
as being a background pixel or a foreground pixel based on the background model, the 
current image frame, and at least one of a prior image frame or a subsequent image 
frame, the processor identifying a background mask for the current image frame; and 

a foreground mask for the current image frame formed as being pixels 
not in the background mask for said current image frame, wherein the object being 
tracked is identified as corresponding to the pixels within the foreground mask of the 
current image frame. 
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9 . The apparatus of claim 8, further comprising a filter which filters the 
background mask of the current image frame to decide whether to change a pixel 
classification from being a background pixel in the background mask to being a 
foreground pixel in the foreground mask of the current image frame. 

10. The apparatus of claim 8, further comprising a filter which filters the 
foreground mask of the current image frame to decide whether to change a pixel 
classification from being a foreground pixel in the foreground mask to being a 
background pixel in the background mask of the current image frame. 

1 1 . The apparatus of claim 8, in which the processor predicts a background 
value for said each one pixel based upon a predicted background value of said each one 
pixel from the prior image frame, a pixel value of said each one pixel from the current 
image frame, and a mixing factor. 

12. The apparatus of claim 1 1, in which the processor classifies said each 
one pixel of the current image frame based in part on the predicted background value for 
said each one pixel. 

1 3 . The apparatus of claim 8, in which the classifying by the processor 
comprises identifying an event from the group of events comprising: prospectively 
include said one pixel in the background mask for the current image frame; motion is 
detected in the immediate past for said one pixel; motion is detected in the immediate 
future for said one pixel; prospectively include said one pixel in the foreground pixel for 
the current image frame; and said one pixel is not to be updated in the background 
model. 

1 4. The apparatus of claim 8, in which the classifying by the processor 
comprises identifying an event from the group of events comprising: prospectively 
include said one pixel in the background mask for the current image frame; a first 
degree of motion is detected in the immediate past for said one pixel; the first degree of 
motion is detected in the immediate future for said one pixel; a second degree of motion 
is detected in the immediate past for said one pixel; the second degree of motion is 
detected in the immediate future for said one pixel prospectively include said one pixel 
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in the foreground pixel for the current image frame; and said one pixel is not to be 
updated in the background model. 



